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Preface 



.Tnis paper deSi-r'ibes an autoprogjiaim^qg sys ten which cons tr;^^ 
enecutaole computer progrgns froQ exaaple conpiitatlons. ,>lessr/ 
Richard SaualJ^d Frederick Petry 'have been in charge of deyJ^iag 
our synthesis algorithns:.' We are greatly indebted to-Mr. /erge 
^ .Fournier of our ?D?-iO staff for help with our systens o/ograniLng * 
proDleas. This work was done at tne CoEputer s&A Infotnation Science 
\ Research Center and was s^pporte'd- by tSe National ^ience Foundation 
*| ■■' >^^.z ;Jc. GJ-^4?39V and by the Departi^nt of CoE)t/er ead Infomation 
Science', r.ie Ohio State University. ' * 

Tne Conpucer and Inf onsation^S^kence Res^rch Cerfter of fne 
. Onio State Uaiveriify ■ is an I'nterdisciplinary r^e^pdi organization 
which consists of tne staff, graduate students, and faculty of cany ' 
University 'departEie'nte and" laboratories. Tnis re'port presents 

• research acconplisned* in coQper.^tion with the Departjaent of Qoaputer 

< - ' ^' . 

and Infomation Science. Tne research was adzdnistered and* oonitoired 

— * , ■ ' ^ 

_sy. ine Ohio State University Research Foundation. ' 
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pa^er describes the construction and laplez^entation of 
prograisaing systea. An autoprogfffrr^er is an ^interactive coi^ter systen 



whlch^ accepts as input exaiq>le calcuiatioos, and vhicb yields conputer * 
prograns for ^dcrisg' these calculationa. 
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1 . ' ' IKTRODDCTION ' ' ' ' 

• ^ "".^^^^S^rosr^ is an interactive ^onpute^ \ 

automatically constructs c«=putir programs f ro= ' exa:=ple conputatlons executed * ' 
by the user. exa:^le calculations. are done JLn a scratch pad fasi^on 

at a con^uter display using a light pen or other graphic Input device, and 
the syst«= stpres a <ietalled history of all of the steps executed in_the'pWs. , 
Then the s^sten autonatically synthesUes the shortest possible pr<;gra. which 
18 capable of executing the observed exa^les.' ■ , ' " 

The autoprogra=dng concept as a progran construction -tecbnlque attempts 
^ to- divide the responBlbilities of nan'and nachine as optinally as possible- 
giving the the creative tasks of choosYng the data "structures and • 
. ^ furbishing the algorithn vhile the i:^chin?' produces the actual code of the 
progran. The user works in" the faslliar domain of concrete examples as- he 
pushes the information around in the data, structures by hand. He does not. 
need to nentally visualise the effects of hi,, instructic»s sin^e they'take ' ^ 
place on the screen before Kis eyes. The c^e created by the nachixxe is 
guaranteed to prec^eely ml^c the actions of .the user in his exar:ples. 
Language s;^tax in the traditiona^ sense is 'totally .absent froa' ^he user's - 
point of view except for the cor^t ordering of the graphic inputs. 
. , This work is al«d-at the development of a sii^le, reliable, eff^ive, 
and convenient program .eynfheslzer. Features will be d'escribed here which 
belp^ the ^tjser cor^ectljr cc^lete his exaapies; wfaTch enable' his to be 
■ .««?ewhat carefree about the style of his inputs, and which enable hL tJ = 
find and correct pfogW errors by dealing with the effects of the program 
.rather' than the program itself. " It is assumed that. the user will change, 
•iis aind often during, the .synthesis process, that "he will want ^to add and 
/ -deieteidata scructyres at unpredictabli tij^ei, that. he kll oike nistak^ 

ERIC ' ' ' ^ 



in his ^anple^tbat mist be corrected, that h^ will want. to>:all subroutines 
that hav^ not yet been created, and that he xaay provide infonaation in a 



fragmentary isanner. The syste^a described here allows for all of these ^ ' 
possibilities without losing its bs^ic siispilcity . of design. 

The next section describes the coiqjutational environsent provided by 
an autoprogratsier within which the user can execute his exasplep. Section 
3 will introduce the basic fornaliscs to be used in th^s paper, In*Section 
4, we will des^jj^ibe the progran synthesis systea and show tHat it is both. 
Bound and ccsplete ' in^thl f oUowing senses: we 'can guarantee that a synthe-*^ 
sized progran will correctly execute j:he given exai^ples' (soxmdness) and that 
ev»ry possible progras (or its' equivalent) can be CMfftl^^y oujr^systesT - 
(cocpletegess)* Section 5 Vill give soi:^ of tii6 Teatures wbiq^ can be built 
into an ajutoprograisser €<5 increase its'conveniince and will discuss how'fbey 
are Incorporated ii^ the total design- Sectioh^ will discuss .soise 
progransiing detail^ of our current systeci tod will give sosie pro^rkssS that 
it was used to create. ^ 




- ■ • 2. , DblKG THE EXAMPLES ' ' , ^ ^ w 

. >^ , An exaapXe calculatioa'begins vlth^a, declaration of tfte name -of the 
i:outine.. to be cteated and My parameter .Inputs to be included witilts call. 

are 'to app'ear 'on the screen are 4eaared. On 
our curreiit sys.tea, these declarations are made at the teletype al'thbugb they • 
X could bfe input graphically as 'are Bost tSther consands. The declarations ' . 
include not only arrays axtd variables but* also pointers i^to arrays.- That 
iSi 15 I has value 3 and is lasted as a pointer into linear array A, then do ' 
arrow labeled I ^1 'point to the third location in A." We can r^,er graphically 
• to the location A<I) by^ touching the pointer auod to location A(S) by touching 
the actual location A(3). This usage will beccsse cleai: in th^ ^xasple to' 

follow. * ' . ■ ^ . . / J * , *. . ■ 

) Once tb^ data structures teve. appeared on the screen, on^aay begin 

the sanple calculation using jthe' graphic input d^ice. Pro.baBlf, the best.. ■ 
such device f o;r aut<T>rograE2ziing would ^e a touch sensitive sifrf ace od the 
- display screen, button our current systcs ve have used ^a- lights- pen^ ^e suspect 
that a touch sensitive screen would yield a ^ch bet;t^ 'systes because It 
would *^ccpt IppCits at a such 6gher rate knd vould. allow the iSrdgraaaer to • - 
use bott hands. In any case^e will irefer to one gra'phlc Input, one pair , ' ^ 
^ of x,y-coordlnatelv^ a touch or a hit* ^ , . ^ 

rtc cosaaands to the sj^tea are^ Indicated by a touch seguentialiy > 
the cOB^d^ilase which appears •on the Bcreea alid each of its <^ecand8. Let' 
p^ stand for the i-th graphical hit after the coaeand is designated. That is, 
pxppose we touc^h sequentially the instruction aove followed by I and J. Then 
PjT^f ^2'^^ and l>y the definition given below, the*cantenta of I will be / 
,ded into^J,\ \ , f / ^ .* , 

We will need eight coaeandfi in out forthcoaing exaaple: — 

O . --r ' • • * R • 



r 




Z-1 , # . . . • 



start - the first iAStructtoa.in any prbgr&\ . 

, ciove - Po ^ Pi- ' • ^ ' • ^ i • 

^•^ . • • ' ; . , . ' ' 

^ i - P2.-^ Pl'*^^ there are -thre6 pt)er3nds: p P^+Po' 

. ^ P2 ^ ^27^1 there ^re three operands^ p^ ^V^yi*^ ' 

subst - t&is is a 'sp^pial operator inventeji for .the. purpose of this^?* 
^canple; apply the graisfetical rule with left hand side at ^ /* 
pj -and f ight^ bafid- side at P2..to string p^ at location- p^ and- . 
put the resiilt ,into' p^/ Ti^ if- Pj^ i^^rences^BCV'P2 references 
" 2YZ, p^ references ABCDE,^ and p^ » '2',.: then AXY2DE ^11 be ^tered 
» into location p^- (Typical^, a subroutine vould be synthesize4 
to do this task rather than creating sucjf. an operator.) ^ 
length " yields the length of strfn^o. ^ ' - . 
print - types ouw on the teletype the string ' . 

^lalt - ends execution of ' the re^tine tai returns control to the calling 
( ^ ^- routine. 
It' is also necessary to indicate xo the systeia when a condition is being » 

.qbecked. For exan^le, in a porting, routine we note tljat two iteas ar^-out of 

• ^ V . ^ ' 

order be'fore we exchange thea: note A(I)>A(J) . So for checking conditions, ' 

we have the relations », >, and < available .with the ustial definitions*' and > 



terminal whiQh ia defi'bed for the purposes of the following exal^le. The > 
predicate tenainil yields i>alue of trua if ajid onlj^ if its operand p 
» , has all terminal syisbbls as defined below^ - ^ * 

Let us suppose that wish to create a pro^raa called GEKERATOftt which 
. generates and prints all of the terminal strings that can be product by ^ 
or less applications' of i^es of aij arbitrary graaaar starting from a given 

initial string. The algorithm will be to generate arli possible lisa^iate 

• ^ ' ' ' . 

' - t • i 



*If X and Y are strings of different length and the shortest one has length i,. 

^ - ' >"*•■'•.'* 

ERJC . ♦ thcaX-Y if tbi? flt«t i cbar.acters of X and Y are identical. - , 



successors of the initial String add to store them, on -a stack. Then it will 
loa<J the top string from the stack, generate all. o"f Its immediate successors * • 
and .add th^ to. the stack, .;and feq forth. Terminal. strings be iisaediat'ely 

printed/and deleted from the- stack as they are generatefT and nonterminal ' 
strings resulting from N applications- of rules will )^ delated to insure 
termination- of the computation.*" \ . » ' 

The autoprogrWr will need an exainple 'cc/Eputatior/?ton iimich to 
donstruct the program ar^ we vill 'choose' the grainsia^ {BA-^^BBA, ABA-^^} using 
ioikrfel string ABA and searching to a dep.th of N = 2. Th6 nonterminals in 
this gracssar are A and B, and the .-ony terminal symbol is a. The data 
structures will be: A* • • - ^ 

^ STRING which holds the current string being processed, 
LEVEL which ^ive:5 the depth of generation of STRING, 
K as defined above, ' - , ^ 

LEFT and RIGHT ^ to hold tWMeft and right sides, of the gr annua t^ffcal rMles 
^RULES to hold the nimber of ruler in the gVamaar, 
^T^TACK and LEVSTACr| r^o hold' the stored strings an<f their levels, -end 
the pointers"?, I, and J. ^ i 

Figure 1 shows how these structures willjappear on. the st^een after they are 
declared. P is a special substring^pointer wfeich references all of the concSnts 

of STftUJG from the p-th character onwards* Thus, if , ? » 3 and STRING « 

/ r ' 

"ABODE", then STRING (P) - "CDE". % * ' ' 

The calculation proceeds as shown in Figure 2 where the commands 'are 

given^n.the leftmost column and their results in the m&ior data structures 

are indicated to the right. Thu^ the first hit is- the sfart instruction, 

th^^cond i^move, the third the literal 0 at- the bottom of the screen, the 

fourth is J, and so forth.' Sc^xming down the figure, one can see' the pointer 

P being advanced across STRING searching for an appli^ticn oi rule 1 of the 
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FIGURE 1 . The autoprograsnaer screen 'before th^ sample calculation begins . 
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2 move 0 EEVEL 

3 move- 0 .J • " » • • 

4 move It 

5 iDOve-^ P ' * . 

6 + 1 P ' ^ 

7 If 

. ^ note LEFT (I) STRING (P) 
. 9 *+ 1 J ; ' ' ^ , V » 

■10'- subst LEFX(I) RIGHT (I) STRlJiG P STRSTACK(J) 

11 + 1 LEVEL LEVSTACKfj) • ' 

12 • + 1 P ^ ■ . ■ ■ 

13^ not^ lengthXLEFT(I))>leng£h(STRING(P)) 

14 + 1 I • , . 

15 move OP • . - 

16 + 1 P ' , ' • • 

17 + 1 J ^ , • - 

18 suljs.t LEFT (I) RIGHT (f^ STRIKG P STRSTACK(J) 
19+1 LEVEL LEVSTACK / '. ' 

20 note terminal STRSTACKj(J) > ■ 

21 print STRSTACK(J) 

22 - 1 J 

23 + 1 P • 

24 + 1 I ,. ^ 

25 riSte I>NORutES 
26. ^feove 'STRSTACK(J) STRIKG 
27 m6ve- LEVSTACK (^J)fLEVEL 
28- - f J • ., . 
29 move II 
3D move 0 P 
31 + 1 P 

• 3? 

t. + 1 P 
+ 1 J . • ' 
subst LEPT(I) RI^T(I) STRING P STRSTACK(J) 
» 36- + i LEVEL 1,EVSTACK(J) " ' 

37 note LEVSTAcK(J) = N , 

3^' -a J • • • ■ 

39^ + 1 P , , ' ^ ■ ■ . , 

40 I I ^ / 

41 move Q P , • ■ ( 

42 '+ 1 P 

S43 + 1 P • 

)54 + 1 P ' • . 

43 + 1. I 

46 note J -^e 0 — * 

47 halt * - ^ 
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TIGHRE 2. The steps of _ati ^xample calculation;^ generating terminal springs ftom a grammar.. 



FRfr*^*^^^*^^""/^ inserted autcjnaticaliy using Che continue feature of Section 5. 
'• . . ■ , -.215 12'/ ■ . - ■ 



gr ammar , step 7, we discoverftule 1 can be applied which, yields the 



•4 



string ABBA in step 9. .^Then the second^rule of the gramnar is ^plied yielding 

stringy a which is printed out/^inally string ABBA is^ brought in from the^ 

\/ ' ' - . 

sSack and its successors are generated in the^^arch for a terminal string. 

• . / 

The halt instructign* termipates the calculation. * . - 

Of course, in actual practice, ^the user never sees .anything like Figure 

2, ^rid his total experience is with the display of Figure* 1 and the movement 

of informatiotr i^om place "to place. We h^v^ found that a programmer* can * 

I** 

execute a surprisingly long sequence of steps without e^d^^BVRnas tlie 
method well in mind. However, suc^ long sequences are almost never 'nec^'ssarj^ 
as </ill be shown in later sections.' . ' * ^ . 

The careful reader will^ ^serve that thTe condition (LEPT(I) « STR^NG(P)^ 
of .step 7 should have also been noted imme<^iatelo^ after step ^5 and immediately 
after step 32. In fact, there are other places in the calculation where » 
conditions were omittW. The rule is* that if every condition i^ properly 



insertec^at least once in the, calculation > 'the synthesis technique properly 



constructs the program. 

vl' 



I' . After one or several example caleulations are ccSiq)lete, 'the. program is 
syn^thesized as described in*- the following ^etions.' 



. 3. " ilASICxDEI^INITIONg ' ' * • . 

Before if i». possible to define the synthesis method and study its'' 
^ properties, it is necessary to fot^oduce some notation. A computation will 
^ be thought -of as .a sequence </f step^s with .the instructions i^ b^in& executed • 
. attthe discrete tiAss t = l.'2.3, ;... : m^ or £ = g:i,2.' .. will designate ' 
a Complete description of the computer memory immediately bef.ore instruction 
^t+1 been pe^rmed. Thus.. instrj^Ction 1^. will operate on memory co^teafs 

Vl y^^" °t "^"^^ b^ written in functional notation as m = i (o M 
- / \, • ^ V ■ t t ^ t-l<' 

Actualfy i^(mj._^) may yield many diff ere^/esults since i^ might be. -for 
' exan^jle, a jead instructidn so we to write e'i^ (m^.,^), 'Referring to 

the ibove eximple in Figure 2. *^ start, i - move 5 J,' and so' forth. 

°^ b^ thoui^*!^ as sequenti-al photdgraphs of the. displayed 

aata structures ,a8ph€comp^tation progresses-. ' ' « ' 

The symbol a will designate an atomic predicate or atom with value true or 
false wh;t«& is measurable by the. machine for the purpose of making btanc'htng 
decisions. "A(I) > A(J)" and "LEFT(l) - STRING(?0". are examples of ' atoms taken 
from the-previoBs section. A signed atom.wiU be either an atom or or a 
negated-^atojn a. -A conc^ition c^. is a predict e' which is a (poSfcLbly empty) 
'conjunction of atoms and/or their negation?. Cj.rwill be represented a|^ 
set of signed N^toms but we will also 'use a functional notation 0^.00^. \^ 

wjiich^ill .have value 'true if and "only if all o'f its unnegated atoms applied 

^ ■ ' " 

to m^_j^ are true and all of its negated atoms applied to m are f.plse. Tt 

C£ is tU^empty set (J, its Value is true* ^ 

" ^^t*^t^ ^ condition-insjtruction pair executed at time t. That 

• •■ 

is, at tlljj^^condition was observed to be true and then instruction i 

* ^ * * » * ' * ^ t 

was executed^ ^ A computation may thus be vl^ldzed as a B^quenc6 of memory ' 
snapshots Separated by conilticn-instruction pairs: 



C/ course, ?iany of the conditions will be the trivial 'empty condition, m 

t / ' # 

, A partial , trace T of a computa'tion will be defined as tlfe (2n+l)-tuple^ ' ^ . 

^ ^ ^\'^V^Vy2'^2' '^n'\^ ' 

where for each t * l,2,^,...n we have 

^ = <S'V' ■ . . ' ■ ■ 

c^(m^^^) is true> and c^ » ^ » 

The instiructions available in the autoprogranming langtiage will be 
denoted ^]^» * ' ' ' ^z* ^ do-nothing starD inst;r^ction ^ 

^nd is the halt instruction. Every program will have exactly one occurrence 
of and usually one occurrence of I^. A trace will b^ a partial trace 
•T ¥ • • - ^^jj,*©^) with the additional requiremeht^ that x,^ « 

.and r^ « ^^n'^H^' ^ particular instruction, say 1^ « move R. S, may occur 
many times in the same program so tb^t it will be necessary to label each 
such occurrence separately. We wij.1 do this by concatenating an integer 
prefix to the Instruction name so that, for example, thi;ee occurrences of . 

would be designated 11^, 21^, and 31^.* These will be called labeled 
Instructions and the positive integer prefix k vill be called the l^el ., - 

An incomplete program P is a finite set of triples of the form 
(qj,Cj^,q^) where each and q^ is a labeled instruction and .Cj^ is a condition 
and where the fdjJLlpwing restriction holds: ^ ^ 

If (q,c,q^') € P4 and (q,e^q") e P and there exists m such that 
^V(m) «_c'(m) « true, then c> c* and q* « . 
Thus an incomplete program is a finite set' of labeled ^istnictions connected 
by triples. or transitions which are each associated with a particular condition 



A transition is .taice^i? its condition i« tPue. and no two applicable tran- 
sltions-.can-ever.-bf siisultaneously satisfied.' An ejcample' of this Moore' ' 
machine _ type, representation appears in Figiire 3.. This ptograia is called ^ 
incomplete because -there is, no starr instru'ctien I ' .and-'Tje'cause the tran- 
.sition {— ojjtVf state 2^ if mi^^ng. ' ' ' " 



^ -^^^^^ ^«^itf«."Po-<>Peratof>B-4l^h^akes-as'^ 

program P and an insjnic^on jy*^ / , • 

B(P^I)-{a|(jI,p,q)eP .for some j,c, and q and aec 6r ,— , aec} 
\ B(P,I) is the set- of- all atoms wbi.ch'^e observed on trsasitions leading 
^ away from- 1 in progtam P. Assuming that B(P.I) = (a^.a^. .'. . .a^,} . then anoiher>^ 
operator B' is defii^^s^he set of>ll minterms Wt can be constructed « 
fi;oB these^toms: . ^ "4.r 

B'(P.I) i {{a^,a2.a3.....a^}.{a.,a2....,-^ a^^}'. ....{-,. a^.-, a^.....-, a^^}}^ 

• Hote that B' (P,-I) -may *4)e empty. 

- '^^program P vd.ll be an incomplete program' with the additional require-'* 

ments that i ■ 

f . ■ • J - ^ ^ ■ 

(l>-for all I (where -1 ?« 1^) such that ai^^,c,q)eP for som^jjCc, and q, 
. • U{c|(jl,c,q)eP}' « B^P.irfor each such j, and 

" (2) there is'exactiy one start Instruction, oaiaeiyMtl , and 

- ' ^.lI^,c,q)eP for some^c and q. . \ 
The^irst requirement means thkt evjery mlntena in B'(P,I) must be represented 
in a transition out of eyery occurrence^ of I. Therefore, ^ after any instruction 
I in the prpgram is execu^, there will be exactly one transition condition 
_ satisfied to a ^ext instruction until the halt is reached. The.^cond ' 
requirement asserts that there, must be exactly'one start instruction. An ' 
e^ple of a program^ can *be constructed if ehe transitions' (n^,(j^llj^) tnd 
' ' (2r^,{— 1 a}, Lip., are- 4<ld^ to the iocomplete pr^f^ of Figure 3'J ^ 
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Before introducing the synthesis aJ^^ltha, it will be helpful to 
broaden the above definition bf B so tliat it can operate on a set S of 



partial traces. 
B(6,I) 



I £n a trac€ 



(B']TeS/ I«i^ for some i^ in trace T atfd ^eo^^j^ — ^ ^^^t+1 



Here B(S,I) js the ?et*of all atoas which are observe! in conditions fpllowing 



T in S. Consistent with the previous definitions,- if B(Sjl) 



^aj,a2,-..,ajj then define B»(S^L) » {{a^^a^, . . . ,a^},{aj^,a2, . . . ,^ -i a^}, 



o • 
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^' THE PROGRAM SYKTHESIS ALGORITHM 

The synthes-is algorithm will be defin/d in terms' of 'four operators, 
'■ ^1,^2,^3* \' ^^'^ S be a set of partiil traces; Me wi'j.>^l define Qj(S) "■ ^ -. 

to be another set of partial traces as fo/ldvs: , if , {c^i.') .b, , . . . , (c ',i ),n ) 

' " ^ ^ * i oiii.iniLn 

is in S, then ^'-(\. C^.i^) .h^W . . . (c;.£^)_.n^) is in Q^(S), where c^ « and 
for t . 2,3.. ...n. cj€B'(S,ij.-_^) and c^i(n^_p is. true. (If B'Cs'.i^^^ 
. ^ * then c^ - Kothing else is iD-Qj^(S)^, K&tioe that c^ is uniguely defined 

since there can be only one nintena c^ in B'(S,i^_^) wfth the property ?hat ^• 
c^(n^_j^)- is true. » . ^ ^ - ' 

is the opera tio^vhich inserts into each tr^te all condi^zions 
which nay have been oaitted by the iiser. Exanining the trace T of Figure 2> 
one sees that the atone I>KORULES and J»0»can iEcediately follow the itvstruc&ion 



+11. Thus . • 



B({T}, + 1 I> - a>KORIJLES, Ji^} 

B'({T>, +11) -{{I>RORDLES, J«0}, . . • " ' i 

{ I>KORULES;-,Ji^ } , 
{-nI>KORULES, JO}, 5, , 

{— iI>!t^>RULES , -tJ-0 } } .- 
Qj^({T» is a trace' sisailar to the one io Figure 2 except that .one of the 
four alnterms in B'({T}, +11) will appear after every occurrence of^+ 1 I, 
and certain other conditions will be sinilafly inserted after other instructions. 

* Let g be a function \^ich puts an order on a s4i of partial traces. For 
eraaple, g(S) say be the set S of partial traces order^'^Jtrfro the sequfencfe 
in which they' were rec4ved. If g(s; - t^^t^,,.:\'i^ is the ordered set 
of partial traces - ^^^^'^ . . tJ>,=^ ^^^-j - 1,2... Mr, 

tbcn-definp f(g(S)) to be fcjie (2(nj^+n2+D3+.'7.+nj^)+2k-l)-tui>le'' 
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f(8(S))-(n^<^>.r<^......r/^>.o <^>.d 

a ^> r r <2) ^ (2) . 



(k), (k^ ^ (k) ^ (k), 



* i. - — - 

^ere d is, called a dueny transitiop aad is distinct fros all Qther sycbols 
in the fomalisn. Then f(g(S)) is one long partial trace vith all of the 
partial traces of S concatenated toother and separated by dursry transitions d. 

Let T « ^^o^^l'^i'^Z'" '^n'\^ ^ partial trace vhich niy be nsade 
up of ^ concatenation of several traces, and let U be an n- tuple of positive 

integers U « (u, ,u,, u ). Tben 

^ 1 c n 



are in U. - ^^i'^2' '^n^' 

T « (a >c ; ,r ,n )} 

oil n n 



Q2-(TfU) is a det of triples vhich constitute an incoeplete progras if U *is 
chosen properlK,_C is the s^t of labels vhich will be applied to the in- 



structions in trace T in the synthes^ of the prograe-*- An ex^sple n-tuple 
that would vork is C « (1,2,3, .... ,n) which yields a linear progras^vlth no 
branching. Using this C 'and the tra<^ of' Figure 2, one can begittp constructing 
Q2(T,0):' (1 start, ^, 2 cove 0 J), (2 eove 0 J,^, 3 sow 1 I), etc. The 



purpose of will be to find a program vhich is ©ore interesting than this 

^linear one. ^ * ' ^ ^ 

» ^ 

He will need a function h wfarf^ch ccnints the nusber of instances o$ 
' instructions in ^ prbgrasa. Define (s| td be the cardinality of the set S, 
and let Z be a se^ of* triple. 
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h(Z)- ix{333z((xty»z)«Z 6r <y,z,x)eZ)} 
■ Thus, if Z is a sfet of tiriples representing a prograE P, then h(z) is the ^ 

nunber of -differetit instances of instmctions in P. ' ' 

\- . ■ < 

' \ «fO ■ <\^i*^2' ."q) D' - (u^,u^,.....,u^) are two integer 

n-t-irples, then we define 0<D' if there is a j , l<j<n, s|ch that 

"l " '^i' "2^2' ■ ^i'^^l' Let k and k' be integers and D and ^ 

.0' be a-tuples, then we define ^,D)<<t',D') if k<k' or if k-k' and tI<D' . 
This puts an ordering on a set of such pairs (k,D) and allows us to^peak 
of ^^Blnlsua. 

Define (kg.Dg) to be the aiairuc.paii (k,0) with the| properties that 
k - h(Q (f(g(Q (S)7),-C)) and (f (g(Q, (S))) ,D) is an inconplete 
progras. Define ^ \ ' 

• ^3^^\' ,^2^^^^^^X^^^^^^S^ desired incossplete prograa. 

Intuitively, one emiserates the set of pairs' (k,U) in increasing order until 

■ ft ! 

^ai>a<^ found such that Q2(f (g(Qj(S))) ,D) is an inconplete prtgrais. Kost of ' 

the possible values for (fe,D) will yield a nondeterainira in the flow of 

. ■ * • 

cotftnrol thus violating the definition of an incoE^jlete prograa. The enuaeration 
will certainly halt sosEewhere because there always exists*li /trivial solutiifc 

(n^(l,2,3 ,n). A pseudo-prograa for coaputing Q^isy^'tdg^ look sose- ^ 

thing lii^ this: . ^ . , 



for k - 1 step 1 until infinity do ' ' ^ ^ 

# for eajh 1^(1,2,3, ,n) such that b(Q2(f (g(Q^<S))),n) - k^do 

* ■ if Q2(f (8(Q2(S))),U) is an incofaplete prograa then 

I 



halt and return Q3(S)-Q2(f (g(Qt4S)).),U); 
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This program will never ent^r an infinite calculation on ,any givea value ^ \ ' 

of k because there are only a finite number of n-tupl-es D which satisfy 

^(1'2,3, ,n). The art of perforaing this ckl'ouiation ^ficifently Is 

discussed in soae detail in [3] 'and will not be farther considered here. 
**■,'« 

For Bost programs of the^size and conp'lexity consider^ in~Sis' paper," this 

calculation can b| cospieted in less than one bundled, aillisecondT. 

We will /review the above synthesis process by doing a sia^ exasplB. ^ 
, . ' •' . * ' \ %^ <^ ' 

Suppose a calculation is performed with the instruction sequeijd« *. ,1 ,1 , 
i ' ^ , 1 ^^2 1 , 

1(— 1 a),I^. Thed. the partial trace is - ' 

- J. * • 

If S - {T}, then ^,\) ' ^a} and B\(S,1^) - {{a}/{~. a}h^ How assui|ie that 
a<Bj^) and a.(n)p a>em true. Qj^ inserts all applicable aint^jlis into f. -i^^ 

- Ql(S) -T(i^;((^.I^),i4,({a},I^),B^,^{a},l2V3Vi<J.Il),a4.a- a},Ig),^^^^ 
Next it is necessary to find a ninitaia (k,D)'S^ch that Q2(f(g(Qj^(S))),D) is 
an incor:q)lete.Dachiiie, Enuiierating each- poeaib^e Ci^^D)7 we find; 



"X^ k - r 'no U's 

' k - 2 no O's 

k - 3 . D » (l,*i, 1,1,1) nondeterainistic 

■»■ k-4,"- '' u - (1^,1,2,1) nondetersdnistic 

* •• k-4 ^''^^^ 'D - -'(1,2,1,1,1) incoeplete prograa 

^ This teriainates the searcj) so kg-4 and Dg - (l,2;i,l,l) Thus Q"^ can.be computed: 
Q3(S) - Q2(f(g(Q^(S))),Dg) . ' , , 

. - {(Ilj^,{a},21j^),(21j^,{a},ll2),ai5<^.lip(llj^,{-, a},!!^:^} . ^ 

- The^resulting^inccnaplete prograa appears in Figure 3. . - 

f ^ 



I 






^^1 ^ 


{-n a} 










. {a; 








• 






' {a} 




."2 


C 





PIGIHE 3. Incomplete .program Q3(S) - {(ll^.{a1.2ip.<21 (a?,!!,). (H..*)-.!!.). 

(li^,{--,a}.n)}. 
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We will define one ciore operator which will convert incoEq>lete 
progra^ with initio states into programs. However, QAS) has the desired 
properties of S'ounciness and conrpleteness, and we will, therefore, prove ^ 
these 'two theore^ b^ore continuing'. ^ ^ ^ . 



We will Ba^ ^haf. aM- inconq)lete program P can execute a partial t;race 
(in^,r^,n^r2,v....,f^,Q^) if there exi^ u^,U2, . . .,u^ and c^^e^,'. , . 

such that for each j f 1,2, )q-1, (u i. c' ,u,^,i,^J e P where ^ 

^Ul^^i^ continue to follow the notation r. » (c. ,i ) for 

j = 1,2,3>|^ .... ,n.) 



Theorem 1 . If S is a set ofj)artial traces, then Q3(S) is an' incomplete 
program which can execute each trace T in S. ' — 7 



The proof follows essentially from the definitions of the various ^ . 
operators. Assume for simplicity ^^t^S has, only one trace, S * {T} whete 

^ ^ (ni^j^^^^l* •••••• »^n*^n\ ^^^^ necessary. -to shew 

ti>at there exists u,,u^, and c' ,c;,. ,c' such that for each 

i / n 12 / n 

But Q3(S>f Q2(f (g(Qj^(S)));Ug) aad-Ug provides the n constants UyU^.xiy 

(Ug - (u^,U2,U3/.....,u^)). Furthermore, f (g(\(S))5y«{m^, (c|,i^) ,m^, (c^,i20 

' /(c^,i^),m/) where « (J. and cj^^^ (m^) is true for j » 1,2, ,n-l by 

definition of f ,g, and By definition of oote that 

cj^l, Uj^j^ij^j^) e (S) for each j « 1,2, ,n-l which completes 

,the proof. A simple extension of these observations will complete the ^Sof 



for the case where S has k;>^l traces, ' * 

'Theorem 1 guaraqteed-^tjiat the synthesized program ((^(B) will be able to 
execute all of the given example traces ik S. The next theorem assures us 

/ '/ 4 ^6 ^ 



- / 



that .if a user-begihs executing exanple' calculations for some program P, 
the system will synthesize a correct program after only a. finite nuab\5r of ' 
exampl^have been completed. P^ will have .the property th^t it can- ekecute 
every calculation that P coulfi execute,' and this convergence property will 
hold without regarJf to the*order of presentation of the examples. " The corollaly 
will futher assert that if P is complete then P^ will be "equivalent"' to P. ' 



1 



id 
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^ 'Theorem 2. Ly: P be an Incompjete program and let be any enumerat'ion 

. of all of the partial traces executable by P.* Then there exists a finite 

^ * • 



k and some incoiaplete program B such that 

o 



/ 



(1) - Q3 ({T^,!^, ,T^}) for all fek, ' ' / ' 

(2) can execute e^ch T^, i « 1,2,3, and 

(3) no prograa with -fewer instances of instructions than P can execute 
. each.T^, i - 1,2,3, • 



This result also has a siiaple proof. Suppose F has- exactly p instance's 
of instructions. Notice that the construction of involves- a coiaplete • 
search through the space of all possible incosplete prograias which cou ld ^ 
execute the traces ami whigh have i instances of instructions for i « 1,2, - 
Since P j#jll exist sos^here in the enumeration done by ^J^* ^^e enumeration 

.^11 be bounded, and Q^^^'^v'^Z' * ^^i^) wilft yield either P or some in- 

/ complete program which precedes P in the enumeration. Thus, there exists" 
a'^nite v such that for all i, Q^({T:^,T^, , . ^. . need enumerate no more 

than V incomplete programs before it can yield its, ^answer. Define 
' ^i ' Q3({Tj^»T2»./. ..»T^}) for each i « 1,2,3,...., and we can think of 
^1*^2*^3* ^ sequence of guesses at the answer P^ over a period of 
^tlme. Then the set {P^(i«l,2, . . . .} by the above argument has finite cardinality 
Also notice that any incomplete program P* that is chosen at some time Qi 



such that^« 



P.) and, later rejected Gj'such that ?*?^P ,) can never be 
chosen again (npt 3 j" such th^t" P'«P._^ , . . This is because if P* ,is 
rejected when it is found unable to execur^ T^^jT^* ...... ,T^^^ , then it will' 

certainly be unable to execute ^72^ ,T^^^ ,^„. So the finiteness . 

|We assume that P can execute only countably many different partial traces. 



of the set {P^|i « 1,2^,3,.- } and the inability to return to previously 

rejected guesses implies result (1) 6f' the theoreo! <:an execute every 
by Theorem T and has minimal size by- construction which completes the 

proof. • ^ ' ^ ^ ■ ' 

V i» • : ^ ' . \ 

Programs and P^ willbesaid/to be equivalent if for every partial 



trace J which begins witlj the start inSt^cfci'on *n TP, can execute T if and 

^Jf^ o 1 ^ ^ 

only if P^ can exe^^^ T. -^ri ^ ' * 



Corollary . ' If -P is a (complete) program; then P 'of Theorem 2 is equivalent 
to P. . - ^ 



Since Theorem 2 assferts >that P^ can execute every partial trape 

executable by P, it is only necessary to sliow that P can execute every partial 

trace^executable by P^ which begins with'll^. Assume the contrary that there 

±s a T « (m , ((^,11 ), m. , (c^.^) , .^j^. , (c ,i ),m ) which P^ can execute 
o o X 2 ^ n n n o ^ 

but cannot. Theq;there is a largest prefix of T> ^y T* « (m ,((lr,ll ),m, , 

^ o ^ o 1 . 

^^2*S^' *^k'Sc^*'\^^^^^^^' which P can execute. Purthermore, since 
P is complete, it can validly continue T^ and can execute T" « (m^, ((^,1^^) ,o^, 
(C2,i2)>-...,(c^.^ij^),iaj^,(c*,i^)/m*) for some cSiS and m* where (cSi') ^ 
0^^,i^^). Bbt P^ cannot execute T" which contradicts Theorem 2 and completes 
tK^prpof . (Comment: P^ say not be completer .even though it is equivalent to 
P.) \ ^ - . ' \ 

^ "^ese results are neither new nor surprising consideriog earlier papers , 
in grammatifcal inference (5, $,\7]. Notice that even though Theorem 2 
guarantees that 'the correct incomplete program 1*^ will be founti after some 

finite time k, there is no way of knowing at any given time 1 whether or 

4 ' 

not P has been found. Thus; there is no pro^f of correctness intrinsically 



buMt into the system'^ and at any tiiaey the'^next partial trace T^^^iSaj ^ 
c^se the system to discard" ^ts current guess oi.P ' and try a new one. 
Thi^ kind of learning is known elsewhere as identification^ in th§ limit 

{5; 6, 7). • i: 

This means that the programmer in debugging his code is theoretically 
no better off with this system than he was wit*i traditional programming^ 
techniques. He still must find errors* by running test cases and by studying 

• his code. From a practical point of view, however', we hope that the auto- ^7 
programmer will provide facilities that w^ll speed this process considerably. 

Applying the synthesis technique to the trace of Figure 2 'yields 

U5*^'?._y-<ClT".x* 2, 1,1, ,1), twenty-three I's followed by 2 followed by 

seventeen I's. The r^esulting incomplete program, is shown in Fjfcfeure 4. 

This would, be a: correct complete program except that two triples are missing, 

♦ 1 P, {LEFT (I) « STRING (P), length (LEFT (I)) > length *( STRING (P)) } , V 1 I}' . 
and (+ J LEV5L LEVSTACK(J), {terminal (STRSTAQjc(J)) ,LEVST^K(J) = N}, print 
STRSTACK(J)) Instruction labels are omitted in Figure A because all but 
one of them are 1. . . ^ ^ * 

Omitted triples in an^ incomplete program can often be guessed ^nd 
filled i^ correctly^ to prbduce'^a complete program. For example, in Figure 
5a^ the condition {a^^,^ a^} has not been obseijved after instruction 11^^ 
arid {—7 ^^^^ observed after 21^. These omissions can Jtake 

place either because it is impossib l e for th e as sociated conditions- Qp occur 



(such as J>2 and J<0) or bemuse they simply have not yet bten observed 
in the traces*. In any case, arbitrary additio;^ of ^the missing transitions 
will npt destroy the guarantees of Theorems 1 and 2 and can often be done to 
achfeve quicker cp^rgence to the desired program. In the case of Figure ' 
5a, it would eeem natural that 11^^ followed b»(aj^,— i a^^ would lead to the 



start 



move 0 LEVEL 



move OJ 



move 1 I 



move 0 P 



• + 1 P 

^ 1 



^5 + 



\ 







halt 



move STRSTACK(J) STRING 
move LEVSTACK(J) LEV^ 
• - 1 J V 



* 4 



+ 1 J . 

'subst LEFT(I) RIGHT(I)^ 
STRING P_^JpS|AeRrJ) 

■t 1 LEVEL IM^QL^;^ / 



{a^,-^ a^} 



print STRSTACK(J) 



{a3,a3} 



r 



-13 



- (LEFT(I) - STRING(P)) 

a^ (length (LEFT'd) ) >length(STRINff(P) ) ) 

a^ - Cterainal STRSTACK(J)) 

a^ - <I>NORULES) 

a^ - (LEVSTACK(J)^ JJ) - 

ag - (J - 0) 



> - h 

FIGURE 4. The program synthesized from the tr$ce of. "Figure 2. (The dotted' 
transitions, one of which is erroneous are inserted by Q, O"" •• 
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same instruction as'll^^ followed by U^j^j^ lIj^f^Eowed by {-r a^,-^ a^} 
and fe^,— J a^} would ^Iso lead to th^^same next instruction. This results in 
the simplified diagt^t^f Figurq 5b, In other words, a reasonable heuristic 
for completing thei^^ogram is to add t;ransitions so as to minimize the total^ * 
complexity of the^oolean expressions on the instruction-to-instruction 
transitionV> For the purposes of this paper, it is not important to more 
clearly defifre Q^(S) other than to say that if QJ(S) is an incomplete prqgratD 
with a start instrucftion 11^, then Q^(S) is a complete program constructed 
by adding triples to Q^(S)- Hopefully Q^(S) will '^etterygppgoximate the desired 
program than Q^C^)- * . . 

Let us assume that operates on the incomplete program of Figure A 
and adds the two missing transitions *as shown with the dotted lines,- It 
turns, out that one of 'these additions has introduced an error into the 
program, and one of the purposes of the next section will be to show how 
this error can be found and corrected* - , > r ^ 
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5. SYSTEM DESIGN AND HAJOR FEATURES 

The general organisation of the autoprograiming system is shown in 
Figure 6 where the major functional units are 

(1) the display and ttp level routines which interface ^th the 
Aiser and which transfer user cocssands to the rest of the systeo, 

(2) the interpreter- which inputs instructions and data structure 
conteats and outputs changes in the data structu?:e contents, andJ^ 

(3) ther^^yntfaesizer which, inputs sets of partial" traces' and outputs ^ 
incoBplete or i^ospl^e progracs , 

The major sbrage areas keep the following inforcation fdr each roi^iue ' 
to be synthesized: 

^ (1) Data structure display^JMomation including each data structure 

r 

nane, type, diEiensior^s, organization, location on the iisplay, • 
pointer inforaation, etr; ' . 

(2) Data structixre" contents: the actual values currently held in 

each location.. , . ^ 

(3) Coaputation traces fros which the routine is to be create, 
J[4) The synthesized prc^ras. 

A Cypi-cal usage o£ the 'systea Is easy to visualize. The prograsser 



enters the name of the routine to be created; we will call it "routine 2". 
'xhen he declares the ^atja stwctures to be associated with this routine, '^'^^ - 
and their descriptions are eit^red into the Data Structure Display Inf onsatibn * 
area as shown in Figure 6. How this ^nfdrmtiori is available to the display 
routines so that the us^r will see these strtictures on the screen. In prep- 
aration for doing an lexaaple calculation, be switches the systes to local i^de 
and enters the example data into the data structures* Local isode insures 
that the itistruction^ he uses will not becocie part of the trace and will 
not be synthesized into tte p.rograa. He can do any other hand calculation ^ , \ 
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FIGURE 6. ^Kajor progr<ms and storage 
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he^waots whijejn^al BJde without affectipg the ;races. Each instruct^ca 
he perforns chat causes changes in the data structures is ii=©iiately \£pd^tkc 
on -the screen, fnen he is ready to begin the exanple, he switches the syst< 
to global Eode and now all instJ-uctions perforsed are saved in the trace . • 
^storage area for routine 2.^The synthesizer is operative at ail tices ^ing 
the s:iallest incocplete progrsa ctn^>a£ible i-ith the ^ces to date in the * 
progras area for routine 2. ^^Thisi, ijyyrqjlete prograa cSH be revised after 
ever^i new trace instruction Without significant corputational loss, and with- 
important benefits to the user to he explained later in this section. After 

the user completes the partial trace {wish or without a halt instruction), 

J ' ' . ■ ' • 

tHe synthesizer applies to turn routine. 2 into a coirplete progras. 

At this point, the .user nay either begin testing the current" Verrs'fon" 

» 

of rouMne 2 or do another cx^z^le. It is ir^or^aut so rez^es^er that the 
traces ray be partial and need not include either a start instruction or 
halt. Thus, the user say want to say: "After reading J, i^J =.1 then. 
^^^^ i f J « 2 th^ print B". This fragmentary Inforr^tion nay be 
^input to the syst^ vith tvo ^arri^J^aces :^ read J, note J « Sprint A 
azid read J, note J • 2, print. B. The synthesized program, vlll alvays be / 
tbe^snallesr progr^ corpatible with -the given traces and the result' of <^ 
these two c^w traces will be additional transitions "glued" into the already 
created- prograr.' tJsual-ly • because of the nature programs,' they will be 
added at the correct position in the^rograa. If they are later found to 

♦ * 

be incorrectly inserted, the pro^asser can do another partial^trace increasing 
the a:r^nt of infoi^tic^ about these instructions. - ?or exas^jlef be'sl^^ 
iSput: ''After K is incrcs^ted at^ J is read, th« If J « 1, print A^* {^^, — 
tut users quickly learn vbat they saist inp^t to get the desired^ograa asd 
^such trial and error revisions are not typical. 
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The fact that the sjmthesizer continuously maintains an updated version 
df'the incoaplet« j>Vograa during trace creation enables us to add ah extreaely 
iaportant feature to the systea. It say be that \rtiile the user is executing an, 
^ exa^le, a partial" prograa will be created which is quite capable of continuing 
or even ccsspleting his exasple for hia. If this is true»^e shoultiCcfe^ainly 
turn control over to this partial prograa and save hieself the trouble of 
doing the instructions by hand. For exasple, if he wishes to add a colusn 

nuabers, the loop r^uired to do the sussing would probably exist in' the ' 
updated progran after be has added the first two or three nusbers, and this 
partial prograa could sua the rest of the colusn autosatically . The continue 
feature then works as foUcnrs: The systea at all tij&es keeps track of which ^ 
instruction in the current ijacosplete progras corresponds to the last 
instruction in the current trace. If the given instruction in the incosplete 
prograa is followai by a valid transition, the cosand continue appears on 
the user's screen along with the other instructions. If the user wishes \. 
to let the synthesized incoeplete progran issue the next instruction rather 

/ ^ ■ ■ . 

than d^ing it himself, be touches the continue cossa^d* Then he can dbserve 
the results of this* continue, and if it is correct and the continue cosxsand r ' 
still r^as /lln^ .^ on ^h4 screen, he can repeatedly hit continue to carry 'on 
the y^aapleT^Ntf^^^^^ contlmie cossand produces incorrect results, he can 

Ct the backup co ^Hnd , undo the effect of the last Instnxction, an<i' inser't 
the correct instruction by band. ; ' * 

The inclusion of such features seans that the experience of doing exastples 
should itot be thought of as feisply a string of baxi^ imserted^instructions. 

The Fy^ogratoer pushes the systea through new parts oi tiie desired prograa, 
uses continue to do other parts of ,the exatsple, backs up, inserefe instructions 
now and then, retufns to continue, and so forth, the reader should examine 
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Figure 2 again to se& how much of that * exaiuple could be done automatically* 

witlT the continue feature, - ' 

^ # ^ 

The backup consaand is available on the sysrea at all'tfeies* so that the 
user can undo any » instructions that he has; execute and decided to erase. 
The backup can be used^^ySJrb^tedly even t<? the point of erasing a complete 
' trace. 

The process of discovering errprs on this syjfeten is similar to chat 
using more* conventional systems » say print^^oyt ^nd study the synthesized 

code, and one nay run a number of test^hjcanples. Suppose the example of 
Seccl^ 2 is run again as a tes^t vith K set to value 1, The synthesized 
progr^ sbouid still find one terminal string, specifically, the' string a, 
but it fails to becajfSe of the last section Inadvertantly inserted an 
error, 'Hot real^Ag why the program'did not print the correct result, s(i 
can display the data structures, initialize to do the'^exasple with N « 1, 
- and in local mode use continue to advance the calculation through, step-by-step. 
It will all go perfectly until 'the instant string is put on the stack atid 
Is supposed to be printed.. Much to our surprise, the synthesized program, 
immediately prases a from the stack' and proceeds to the next step* At this 
' poijit, we can back the calculation up to the point where a was about to be 
put on the stack, switch to global mode to* create a -partial* trace, use continue 
to put a on tl)i&^tack agaip, insert the prlAt STRSTACK(J) instruction, use 
continue to check that the^calclfi^^^*^ proceeding normally, and terminate^ 
the partial trace. ..The synthesize program will now include a corrected 
transition which wl]^ do this example and all other examples correctly, i^otice 
that the cause of error was discovered by examining the effect of the code 
in the data structures, and t)ie error^ was. removed by forcing correct action 
at the point of error. Thus, errors can he found and corrected without direct 
reference to the code. * . • ^ r* — 
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The example of Section 2 is now in perfect working order but, as usual,' . 
the progranaer may wish to change it in some-way. This can be done using 
the override feature while running a new sample calculation. Msume'that it 
is desired to put a counter CODKT intp the" program which counts the number . 
of terminal strings which have been printed, 'and then it is desired to. print / 
the total count .before halting, the programmer first declares the new variable 
so that it will lappear.on the screen. (Declarations can be made or deleted 
at any cime.)/Then he initializes the data structures to do'an example, 
sets the mode to global, and used continue to begin, advancing automatically 
through the example. Imsediatay after the 6<art instruction, he touches 
the override consnand, loads zero into COUNT, and then returns to usage of 
the continue ^instruction. The eff^^ct of the override cosssand is to return 
to all previous traced a'nd replace theSj— fe^.i^) tern that would have 
been executed ^t this point "by the 'duney. symbol d. Since .this symbol* d is 
used 88 a sAparator between traces, such an insertaion effectively cuts the 
trace*into tyo partial tra^s as well as eliainatfing the unwanted transition, v 
The progra^r noii proceeds forward with the continue feature until a 

■■^ ^ y ' 

• terminal string is printed at which tike he touches override, increments 
— COUNT, and returns again to contiiwe. As he proceeds, he will^be gratified 

* 

to Bee COUNT autosiatically increment^ as othar terminal strings are generated 
since the continuously updated progifSa will have already itrcorporated his 
change. Finally, just before the halt instru<ition, the prograsaer uses 
override one more tike to cause COUNT to be printed. The autoiaatically 
• synthesized program vill >e iden^cal to the ^rlier version except that 
the variable count is now included and will be^correctly initiaptfzed, incre- 
■^""lae^ted, and printed. _^ 

The fact that ^he override f:eature chop^up earlier traces does , ^ 

not affect the convergence guaranteed by Theorem 2. That theorem states 



that any enumeration of partial traces 'converges on the desired P^, and thus 

an arbitrary amount of chopping on the early traces "will not prevent a correct 

C 

synthesis • Of course/ the, decision to alter the synthesized program means 
that the goal program has been Changed, and the purpose of thS* trace 
dele^tions made hj/\yerride is to make the 'set of traces compatible with the' 
new goal progi^. BecauSe chopping of the traces does not eliminate convergence 
the override f eatur|j;^aaJr\^used without limit to make changes to a synthesized 
program. The only cost i^sing this feature is a slower convergence to 
. due to the information lost inVhe deletions. 

The subroutine feature enablfe*— tfee programmer to build a large program 
"out of many snaller ones and to properly modularize his task. ^Ith an 
autoprogr^er^ it also makes it po8Si>le to deal with shorter traces, ^ftd 
fewer data structure^ on the screen. As e^h new subroutine is created, some 
of its data structures can be designated as arguments to be supplied at the 
time of the call. One of the instruction^ available on the screen is CALL 

SUBROUTINE which bay be used like any other instruction. If CALL SUBRDUTIKE 

r 

is hit at any time, the names of all subroutines created to date including 
the current subroutine appear on the screen and the user can designate which ^ 
one he wants. Then he touches among the current data structures the argxjments 
for the routine. After the subroutine cife is made, the connections at (a) 
and (b) in^^^gure 6 are moved to> say, (c) and (d) to reference the called 
progr^ and its data structure contents. These connections, of, course, return 
to (a) and (b) when the subroutine execution terminates, 
J Many t^s a programsaer in the-pr'ocess of doing an example suddenly 

realizes that he~ would like to call a subroutine to do a task that he has 
not anticipated, tn ti}isl^ase, he can execute CALL $UBROUTINE and type 
in the name of the desired subrotffine even though it does not yet eiist. 
Then hp can inser^ on the screen the results the subroutine would have yielded 
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^ if it did exist and proceed onward. Thus, he. can xio top down prograraaing 
in a fairly convenient manner. If he wishes to execute this routine before 
^creating its supporting subroutines, he, of course, mus«be willing to fill 
in by hand the results of every call to every nonexistent subroutine. 
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6- . AN IMPLEMENTED AUTOPROGRAMMER 

An autoprogramming system for integer calculations has been implemented 

I ' ' 

and tested extensively by the authors. The system uses a Digital Equipment 

Corporation Model 340 display ,with light pen connected to a PDP-10 computer. 
The implemented instructio^ are add, subtract, multiply *j divide, mov4, 
read, write, call subroutine', ai?d note greater than, equaQ to, or less than/ 
The allowed ^ata structures are individual variables, linear, and rectangular 
integer arrays. . 

Because some of the features descrd^ed in this paper have only recently 
Seen developed, they were not , incorporated' into the origiiial design- The 
synthesis algorithm In this paper, for example, allows the user to freely . 
omit conditionals during a sample calculation as long as each conditional 
.is pfoperly inserted at least once. The implemented system laakes more 
stringent re<iuirements on the user. Continuous updating of the synthesized 
program during a computation is not available so the continue and override 
features are not included. This system does, howey^,^ include a convenient 
subroutine feature with recursion, the backup feature, local and global modes, 
and the ability to add and remove data structures at* will. 

The t)ata Structure Contents array of Figure 6 was impl^ented using a 

hajBh coding scheme with the key computed, from a combination of the dat^ 

* . • 

structure name, its associated subroutine name, the level of the call_(ln - 
a hierarchy of calls), and the array indexes, if any. This organization 
is quite convenient in that, it makes the subroutine featiagcW rectirsiVe without 
any additional coding and it effectively Jjicrctases all arrAys to an ^f init^ 
kize as long as the hash table is not full. Thus, an array \ which is declared 
to jbe two-by-two will appear on the screen to be that size ^t syntheala. 
time. However, at execution time when the subroutine is called, it can * 
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referfence and use the 100,100-fh entry of the array without concern about 
overflow. This is quite important because^the Timited^ze of the display 
screen prohibits the declaration of large arrays. 

An example program synthesized on this system appears in Figure 7, ' 
' the sorting algorithm kno^s "quicksort" [8] . The program accepts three 
arguments^ a linear array A to be sorted and the bounds Nl and N2 for the ' 

sdrt. ^QUICKSORT (A, Ni,N2) reorders the entries ACNl+l),-* A(Nl+2) A(N2> 

into ascending order. One can create this routine by executing the Jlgorithm' 
on the example list (2,7,1,6,3). Set the pointers PI and P2 to the entries 



given by Nl and N2: 

2 7 

■ ^ ■' 
PI 



3 
+ 

P2 



Advance pointer PI until we note that A(P1)>A(P2): 



1 ' 



PI 



3 
+ 

P2 
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Exchange those entries and then decrease P2 until we again note that A(P1)>A(P2): 
2 3 16 7 

?JL - P2 

" C _ 

Exchange those entries and increase PI until P1-P2, - - ' ' ' '. 

_ - i -r 6~ '7 . ' . ' 

P1=P2 

Decrease PI by one, call recursively Qin;CKSORT (A,N1,P1) and QUICKSORT 
(A,P2,K2) to coffiplete' the sort, and halt. Because th6 program^ is not synthe- 
sized until the trace is cospleted on this '^stto, the recursive calls to 
QUICKSORT result in a message from the system: ''This routine does not exist",^ 

'■ ^ 

Buj: the trace is correct and the fact that the calls result in no actign^TT^ 
the time of the example calculation is of no conceit If it is important to 

have the results of calls to nonexistant routines updated on the screen during 

* — 



Start 



Nl = ^2 



Halt 



PI 

$ 


• Nl 


. P2 -*-'n2 








+ 1 PI 



PI - Pa 



A(P1)>A(P2) 



'Temp ^feisACBIX 
aM)-^A(P2) 
A(P2)-fTemp 



- 1 pr 



' ) 





Temp A(P1) ' 


ACPI) 


^ A(P2) 


A(P2) 


Temp_ 



Call QUICKSORT (A,Kl,Pi) 
. Call QUICKSORT ^,P2,N2T 



• V 



Halt 



I^Pl . P2 . 



.4 



i? 



• • ;- '-^^ 

FIGURE 7. A sorting routine created 
with an^autoprogranmer: 
^ • QUICKSORT ^^1,N2) 
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a sample calcJlation^ these results can be inserted by hand using local mode. ' 
Ngxt we execute another example calculation sorting the list (2,1) 
^ and an example with arguments Nl - N2 - 0'. ter completing these three 
traces, the program of Figure 7. is correctly synthesized. . , 

, Careful examination of Figure 7 Reveals that this' autoprogrammer handles 
conditionals differently from' the algorithm of Section 4. After executing ' 
an instruction.' the transition with the true condition is taken, and df no 
condition is true, the unlabelled transition is taken. Unfortunately, this 
occasionally leads to .a nondeterminism with two oi> more valid transitions 
which must be resolved either with additional traces' or by answering a "query 
from the system. j ■ ^ ' 

1^ Another -progr^ created on the autgprogriMt^s a coiipiler for a " ^ 

simple ALGOL-like language^ cailed Y73. This lai^Rge has ^epn-used as 
the source language for a compiler writing 'exercise in programming classes 
and^has o^y integer mode, no 'arrays, atid no sabroJtine feature. '^e ' 

^available key words in Y73 are READ, WRITE,. BEGIN, END, WHILE, POSl and 
NPOS.^ Jhe WHILE statement has the' form VHILE e .x. p; which means "while' 
arithmetic expression e has the property x, continue repeating program p".- 
X is either POS (positive) or NPOS (not positive) and r d^s a program bracketed - - 
by a BEGDJ and an END. A typical program in Y73 appears in Figure 8. The 
object code *for the. compiler was IBM 370 mac]ilne langiiage* 
^ Of course,' both the input and the output for cBi' compiler had to 

cdded into inte^rs by band because th% current autoprogranaaer bandies ^ . 

only integets. Thus, the input tokens^ were coded 1 for 2 for 

8 ; , 10 for READ^ , and 17 for BEGIN. Identifiers were 

coded 21,22, ,29, and constants were cpded^^JO for 0, 31 for 1, etc. 

This means that the input program was a sequence of integers; in the ca^e 
of the program of Figure 8, it would be 1^ 10, *21, L.... . 



y 



BEGIN 



'read . N; • ^ 

WRIT-E N;. /■ ' ^. 



WHILE N-i .POS. 
BEGIN ' 

WHILE N-N/2*2- . pOS . 
BEGIN 

N =*1 + 3 *. N; 
' { WRITE N; 

END; 
N = N/2; 

♦ 

mUE N; 
. END; 

END; 



FIGURE- 8. A prograaj in the language Y73 which was cotapiled with aa auto-^ 
programmer created'-'compiier. 
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■An example ©utput instruction from this coigpiler would be "load indo 

^ register 5 from the location addressed by base register 12 with a displacement * 

of 20". This instructiori^uld"be 585C-0014 in IBM hexadecimal and would be 

prirfted-ottt 6y 'the.iautoprogrammed compiler' as, * 

y INST » 88 88 (decimal) = 58 (hexadeclma-lj 

^ Rl'»5 ♦ ' - ' 

. R2 « ^L2 ■ */ 

. DISP = 2t ■ - - 

Except for this coding problem, the object code was directly exequtab^ on 
-. the IBM machine. ^Thg^^lEAD and WRI^ instruction were implemented with locally 
defined supervisor call iustrructions. 

This autoprogranaaing syst&zi has been used to create the above jiencioned 
conpHer which involved fifteen subroutines, a prograa synthesizer similar 
to the fuil^ion described above, and dozens of ' other programs* Tne amount 
of effort required to produce the^e programs does not differ greatly from 
that required using more "conventional, systems. It is hoped that a« all the 
features discussed in the paper^becose implemented and as others are 
developed, autoprogrammidg, will, in fact, become a des'irable alternative 
to conventional systeoa- 
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7. DIStUSSIOH ' * ' 

Auto*prograiziaiTig is by n^turr a language independent conc^^^and can 

provide the context for cany *dif f erent 'kinds of coaputing* Tne approach is ; 

designed to put thfe user in intimate contact with his da^e stirtictxires an4 

\ . . * 

the events which affect then/ .It; enables the u^r to crea£e, debug, and 

riodify his program by working vit|i ^;ha "effects of the code rather than ^ the . 

^ / ' . " ' * . . 

, code itself. The approach puts xTv^ cian and riachine in a truly^ interactive 

relationship at the tine when^ the souifpe code is being created, and It 

breaks avay frorr the batch isDde psychology:' J^te tfhe program, type the code, 

and conpile. ^ • ' - ' * ^ - , j 

i ' ' ^ • * i • . ' 

Our research has enphasized' sirrplicity i5f design both in the autoprogran-- 
aing language and in the totai ffystes. Became the .language is -without 
syntax in the tratttional sense *and because the results of each instruction 
are updated inis^diately before th^ usei^'s eyes, the aapunt of training required 
for a nev user is minical. We believe that the special syster: features 
such as continue, backup, and' override should be few in rsudber and sa sisrple 
and obvfous in their operation that the novice prograsrier can use thc2 
imedis^ely^and without hidden dangers,^ ^ , 

Our current work is ained at developing language f&tures ^nd error 
correction nechanisss which will enable the prograrziter to be 2:;ore casual ^ 
and less derailed in his execution of examples and to still ciaintain the 
expectation that a correct prograc will be created. 
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